#autoregressive models

Researchers at the National University of Singapore introduce Dimple, a novel discrete diffusion multimodal language model that enhances text generation efficiency and control, outperforming similar autoregressive models.

Dream 7B introduces a diffusion-based reasoning approach that enhances AI's ability to reason, plan, and generate coherent text, outperforming traditional autoregressive models.

Meta AI's Token-Shuffle method reduces the number of image tokens in Transformer models, allowing efficient high-resolution image synthesis with improved quality and lower computational cost.